Determining a quality score for internal quality analysis

ABSTRACT

An apparatus for assessing and controlling the quality of a project in a production environment is provided. The apparatus is configured to: receive a first score, wherein the first score comprises a first numerical value associated with a first level of quality, wherein the first level of quality is associated with a first deliverable; receive a second score, wherein the second score comprises a second numerical value associated with a second level of quality, wherein the second level of quality is associated with the first deliverable; and process the first score and the second score to generate a third score.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application of U.S.non-provisional patent application Ser. No. 13/944,139, filed Jul. 17,2013 of the same title; the content of which is also incorporated hereinby reference in its entirety.

BACKGROUND

There is a need to efficiently assess and control the quality of aproject in a production environment.

BRIEF SUMMARY

In some embodiments, an apparatus for assessing and controlling thequality of a project in a production environment is provided. Theapparatus comprises a memory, a processor, and a module stored inmemory, executable by the processor, and configured to: receive a firstscore, wherein the first score comprises a first numerical valueassociated with a first level of quality, wherein the first level ofquality is associated with a first deliverable; receive a second score,wherein the second score comprises a second numerical value associatedwith a second level of quality, wherein the second level of quality isassociated with the first deliverable; and process the first score andthe second score to generate a third score.

In some embodiments, the first score comprises at least one ofquantitative information or qualitative information.

In some embodiments, the second score comprises at least one ofquantitative information or qualitative information.

In some embodiments, the quantitative information comprises at least oneof a numerical value, a percentage, a point value, or a score.

In some embodiments, the qualitative information comprises at least oneof a scoring criterion, a level of quality, or a keyword.

In some embodiments, the first deliverable comprises at least one of aproject goal, milestone, or product.

In some embodiments, the first deliverable is associated with a phase ofproject execution.

In some embodiments, a color is associated with at least one of thefirst score, the second score, or the first deliverable.

In some embodiments, the color indicates at least one of a status, alevel of completion, or a level of quality.

In some embodiments, the apparatus comprises a numerical value thatdefines a threshold that, when crossed, determines at least one of acolor, a status, or a quality score of the first deliverable.

In some embodiments, the apparatus of transmits a message to a user.

In some embodiments, the message comprises a notification of thegeneration of the third score.

In some embodiments, the user comprises at least one of an internaloperations specialist, a project manager, or a member quality assuranceteam.

In some embodiments, the apparatus is further configured to provide achecklist, wherein the checklist includes required items and tasks thatare to be completed within the scope of the deliverable, a qualityscore, wherein the quality score is defined by weighting responses torating criteria, and a comments section.

In some embodiments, the apparatus is further configured to define atleast one control objective.

In some embodiments, the apparatus is further configured to provide auser interface for determining a quality score for a deliverable,wherein the user interface includes a checklist, scoring criteria, aquality score, a weight, and an overall score.

In some embodiments, a method for determining a quality score forinternal quality analysis is provided. The method comprises: receiving afirst score, wherein the first score comprises a first numerical valueassociated with a first level of quality, wherein the first level ofquality is associated with a first deliverable; receiving a secondscore, wherein the second score comprises a second numerical valueassociated with a second level of quality, wherein the second level ofquality is associated with the first deliverable; and processing thefirst score and the second score to generate a third score.

In some embodiments, a computer program product for determining aquality score for internal quality analysis is provided. The computerprogram product comprises a non-transitory computer-readable mediumcomprising code causing a computer to: receive a first score, whereinthe first score comprises a first numerical value associated with afirst level of quality, wherein the first level of quality is associatedwith a first deliverable; receive a second score, wherein the secondscore comprises a second numerical value associated with a second levelof quality, wherein the second level of quality is associated with thefirst deliverable; and process the first score and the second score togenerate a third score.

BRIEF DESCRIPTION OF THE DRAWINGS

Having thus described embodiments of the invention in general terms,reference will now be made to the accompanying drawings, where:

FIG. 1 is a general process flow for assessing and controlling thequality of a project, in accordance with embodiments of the presentinvention;

FIG. 2 is a general process flow for determining the quality of aproject, in accordance with embodiments of the present invention;

FIG. 3A is an exemplary user interface for the Phase Level, inaccordance with embodiments of the present invention;

FIG. 3B is an exemplary user interface for the Deliverable Level, inaccordance with embodiments of the present invention;

FIG. 3C is an exemplary user interface for the Deliverable LevelArtifact, in accordance with embodiments of the present invention;

FIG. 4A is an exemplary user interface for determining the quality scoreof a deliverable, in accordance with embodiments of the presentinvention;

FIG. 4B is an exemplary user interface for determining the overall scoreof a phase of a project, in accordance with embodiments of the presentinvention;

FIG. 4C is an exemplary user interface for determining the overall scoreof control objective, in accordance with embodiments of the presentinvention; and

FIG. 5 is a block diagram illustrating technical components of a systemfor assessing and controlling the quality of a project, in accordancewith embodiments of the present invention.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

Embodiments of the present invention now may be described more fullyhereinafter with reference to the accompanying drawings, in which some,but not all, embodiments of the invention are shown. Indeed, theinvention may be embodied in many different forms and should not beconstrued as limited to the embodiments set forth herein; rather, theseembodiments are provided so that this disclosure may satisfy applicablelegal requirements. Like numbers refer to like elements throughout.

In some embodiments, an “entity” as used herein may be a financialinstitution. For the purposes of this invention, a “financialinstitution” may be defined as any organization, entity, or the like inthe business of moving, investing, or lending money, dealing infinancial instruments, or providing financial services. This may includecommercial banks, thrifts, federal and state savings banks, savings andloan associations, credit unions, investment companies, insurancecompanies and the like. In other embodiments, an “entity” may not be afinancial institution.

In some embodiments, a “user” may be an internal operations specialist,a project manager, or a member quality assurance team associated withthe entity.

The present invention may enable an apparatus (e.g. a computer system)associated with the entity to efficiently assess and control quality ina production environment. In some embodiments, a framework may beprovided for managing and maintaining the quality of a project as theproject moves through various phases of project execution. The frameworkmay include a unique combination of proprietary and third partyprocesses that ensure a desired level of quality is maintainedthroughout project execution. All in all, utilizing the presentinvention may help teams to meet and/or surpass industry-standardexpectations.

The framework may include a user interface from which the user manages aproject. In some embodiments, the user interface may include a visualrepresentation of the project and its associated phases of projectexecution. For example, a block diagram or a map may depict how eachpiece of the project is connected. In other embodiments, the userinterface may define a menu, a table, a list, or the like. A typicaluser interface defines three menu levels: a Phase Level, a DeliverableLevel, and a Deliverable Level Artifact.

The Phase Level menu may include an overview of the project's phases ofproject execution at the highest level of abstraction. In someembodiments, one or more phases of project execution may be defined bythe framework. Typically, the framework defines phases of projectexecution across one of three methodologies including Agile, AcceleratedWork Effort (AWE), and Define, Analyze, Improve, and Control (DAIC). ThePhase Level menu may enable the user to view or select at least onepiece of the project associated with the defined phases of the project,including a deliverable, a team, or the like. In some embodiments, acolor may be associated with the deliverable indicates a type ofdeliverable, such as a risk deliverable or a standard deliverable. Inother embodiments, an icon (or another indicator) may indicate thatthere are multiple sub-deliverables associated with the deliverable. Forexample, if a deliverable includes a “plus sign” icon, the deliverablemay include multiple sub-deliverables. In alternative embodiments, acombination of the color and the icon may be utilized throughout thePhase Level menu.

When the user selects a deliverable from the Phase Level menu, theapparatus may be configured to present to the user the Deliverable Levelmenu interface (e.g., when the user selects a deliverable (e.g.,Deliverable 6) from FIG. 3A that has a “+” icon). The Deliverable Levelmenu interface may include a team or a sub-deliverable associated withthe selected deliverable. The user may also select a Deliverable LevelArtifact from the Phase Level menu (e.g., when the user selects adeliverable (e.g., Deliverable 3) from FIG. 3A that does not have a “+”icon).

When the user selects information associated with the selecteddeliverable or associated sub-deliverable, the apparatus may beconfigured to present to the user the Deliverable Level Artifactinterface. The Deliverable Level Artifact interface may provide the userwith information associated with the deliverable, including but notlimited to a list of critical elements, a deliverable title, a controlobjective, a description, a usage, a timeline, a deliverable dependency,an update, a team name or a list of contributors, a status, a link to adeliverable, or the like. The Deliverable Level Artifact interface mayserve as a hub for information associated with a deliverable (or anassociated sub-deliverable). The user may better understand how thedeliverable and its associated information are connected to otherdeliverables, sub-deliverables, team members, or the like of a project.

The information included in the Phase Level, the Deliverable Level, andthe Deliverable Level Artifact interfaces may be sorted or filtered by avariety of criteria including a deliverable title, a date, adescription, a usage, an update, a team, a template, or the like. Theinformation may also be edited, modified, deleted, or added by the user.Typically, the user is removed from the project itself, such as a memberof an internal quality assurance team. If the user is directlyassociated with the project, such as a project manager or a developer,he or she may not have access to edit, modify, add, or deleteinformation.

Each phase, deliverable, or control objective of the project may alsoinclude a threshold value associated with a level of acceptable quality,progress, or the like. By assessing the level of quality, progress, orthe like of each deliverable, the apparatus may determine whether or noteach deliverable is of adequate quality, progress, or the like and maypass through a tollgate. To accurately assess the quality of the project(and each of the project's associated phases, deliverables, or controlobjectives), the user may utilize a Deliverable Quality Assurance (DQA)program.

The DQA may include a checklist of required items for project execution.The checklist may include a list of sub-deliverables or controlobjectives that are to be included in each deliverable. Further, thechecklist may provide a control objective, scoring criteria, a referenceto Enterprise Change Standards (ECS), a status, a weight, a numericalvalue, a comment, or the like.

The checklist may be used to evaluate the quality of the deliverable.The user may manually enter information or responses to items that areon the checklist. The apparatus may then calculate the level of qualityassociated with the deliverable. In other words, the user's responses tothe checklist may be processed by the apparatus to create an overallscore of quality for the deliverable.

Any deliverable may be rated based on its adherence to criticalelements. The critical elements may include all items orsub-deliverables that are to be included or addressed in thedeliverable. This may ensure that if all items in the DQA checklist aremet, there is a high probability that the deliverable will be inaccordance with ECS as well. Essentially, the DQA may serve as anadditional (and perhaps more thorough) level of internal qualityassurance.

Based on its adherence to the critical elements, the deliverable mayreceive a review score. This review score may be defined by the scoringcriteria, which may include approvals, a description of the project, orthe like. In some embodiments, a color, a numerical value, or a weightmay be associated with the review score. Typically, the review score isdetermined to be high (colored green and associated with a numericalvalue of 5), medium (colored yellow and associated with a numericalvalue of 3), or low (colored red and associated with a numerical valueof 1). Each assigned review score may be weighted such that thecombination of all review scores for a particular piece of the projecttotals to 100%. The combination of each review score may generate atotal score for the deliverable.

Similarly, the total score for each deliverable may be collected andprocessed to form an overall score for the project as a whole. Theoverall score may determine how the entity will continue with projectexecution. For example, if the overall score of the project is quitelow, then the entity may decide to revisit or restructure the plans forthe project. Conversely, if the total score of a deliverable is high,the deliverable may pass the DQA test tollgate and be cleared for thecontinuation of project execution. The user may interpret the reviewscore, the total score, or the overall score at any stage of projectexecution.

In some embodiments, the checklist may be directed to measuringquantitative items of the project. In other embodiments, the checklistmay be directed to measuring qualitative items of the project.Typically, the overall score for the project is calculated by combiningthe total score associated with quantitative items and the total scoreassociated with qualitative items.

The checklist may be edited, viewed, deleted, or created by the user. Insome embodiments, the apparatus may be configured to prefill orautomatically complete the checklist. In other embodiments, thechecklist may be executed manually.

In some embodiments, the apparatus may transmit a message to the user inresponse to calculating of the quality score or the overall score. Themessage may include a notification that the DQA process is completed,that a particular status has been reached, or the like.

Currently, the entity may utilize Enterprise Change Standards (ECS). ECSmay define a set of guidelines and/or industry standards which theproject design, development, and execution may follow. By adhering toECS, the entity may be able to maintain the progression of the projectat a high level of quality. In some embodiments, ECS includes at leastone control management system. The present invention may uniquelyintegrate ECS and its associated control management systems into theframework.

All in all, the purpose of the framework may be to ensure a desiredlevel of quality throughout the project execution phases of a project.By evaluating each deliverable based on industry standards andproprietary scoring criteria, the framework can increase efficiency inthe entity's project execution processes. An easy-to-navigate userinterface and innovative quality assessment tools may simplify themanagement of the project.

FIG. 1 presents an exemplary process flow diagram 100 for implementingthe framework. At block 110, the process includes receiving adeliverable. At block 120, the process includes processing thedeliverable, wherein processing the deliverable comprises assigning aquality score to the deliverable. At block 130, the process includescomparing the quality score value to a threshold value. At block 140,the process includes determining if the deliverable requires an actionin response to comparing the quality score to the threshold value.

FIG. 2 presents an exemplary process flow diagram 200 for processing adeliverable using DQA. At block 210, the process includes receiving afirst score, wherein the first score comprises a first numerical valueassociated with a first level of quality, wherein the first level ofquality is associated with a first deliverable. At block 220, theprocess includes receiving a second score, wherein the second scorecomprises a second numerical value associated with a second level ofquality, wherein the second level of quality is associated with thefirst deliverable. At block 230, the process includes processing thefirst score and the second score to generate a third score. The thirdscore may be generated by totaling the first and second scores or bygenerating an average of the first score and the second score, or bygenerating some other mathematical computation of the first and secondscores.

FIG. 3A presents an exemplary user interface for the Phase Level menu.The defined phases of the project are listed at block 310. Each phase310 may include at least one deliverable 320 that includes informationabout the deliverable. A color 330 indicates a type of deliverable. Anicon 340 indicates that there are multiple deliverables orsub-deliverables associated with the selected deliverable. Uponselecting a deliverable, the user may be presented with the DeliverableLevel menu.

FIG. 3B presents an exemplary user interface for the Deliverable Levelmenu. The Deliverable Level menu may include a map of connectivityassociated with the selected deliverable. For example, the map maypresent the team 350 associated with the deliverable, as well as anyassociated deliverable artifacts 360. The user may select to view anassociated deliverable artifact 360.

FIG. 3C presents an exemplary user interface for the Deliverable LevelArtifact interface. The Deliverable Level Artifact interface may includeinformation associated with the selected deliverable such as generalinformation 380 (information associated with the team, the project, thedeliverable title, a reference system, or the like), a control 390, acritical element standard 392 (definition of the critical element), adescription 394, a team of responsible parties 396, or the like.

FIG. 4A presents an exemplary user interface for assessing quality of adeliverable via the DQA checklist. The deliverable's quality may beassessed based on at least one required element 400, ECS criticalelement 410, control objective 420, or scoring criteria 430 which mayaddress either qualitative or quantitative aspects of the deliverable.Each scoring criterion 430 may include a weight 440, which may place adesired emphasis on certain scoring criteria 430. A score 450 may alsobe associated with each scoring criterion 430. A total score 460 may becalculated by combining the scores 450 of each rating criterion 430using an average or similar computation.

FIG. 4B presents an exemplary user interface for determining the qualityof a phase of a project. The phase may include multiple deliverables 470which may each receive a quantitative score 480, a qualitative score490, a total score 492, or comments 494 based on the DQA checklist. Theapparatus may calculate the overall score 496 for the phase of theproject's quality. Based on this overall score 496, the entity or theuser may be able to make a more educated decision about the developmentor production of the project.

FIG. 4C presents an exemplary user interface for determining the qualityof a control objective. A plurality of control objectives 491 may eachreceive a quantitative score 493, a qualitative score 495, a total score497, or comments 498 based on the DQA checklist. The apparatus maycalculate an overall score 499 for the control objectives' 491collective quality. Based on this overall score 499, the entity or theuser may be able to make a more educated decision about the adherence ofthe project to control objectives.

FIG. 5 presents an exemplary block diagram of the system environment 500for implementing the process flow described in FIGS. 1 and 2 inaccordance with embodiments of the present invention. As illustrated,the system environment 500 includes a network 510, a system 530, and auser input system 540. Also shown in FIG. 5 is a user 545 of the userinput system 540. The user input system 540 may be a mobile device orother non-mobile computing device. The user 545 may be a person who usesthe user input system 540 to execute a user application 547. The userapplication 547 may be an application to communicate with the system530, perform a transaction, input information onto a user interfacepresented on the user input system 540, or the like. The userapplication 547 and/or the system application 537 may incorporate one ormore parts of any process flow described herein.

As shown in FIG. 5, the system 530, and the user input system 540 areeach operatively and selectively connected to the network 510, which mayinclude one or more separate networks. In addition, the network 510 mayinclude a telecommunication network, local area network (LAN), a widearea network (WAN), and/or a global area network (GAN), such as theInternet. It will also be understood that the network 510 is secure andmay also include wireless and/or wireline and/or optical interconnectiontechnology.

The user input system 540 may include any computerized apparatus thatcan be configured to perform any one or more of the functions of theuser input system 540 described and/or contemplated herein. For example,the user 545 may use the user input system 540 to transmit and/orreceive information or commands to and from the system 530. In someembodiments, for example, the user input system 540 may include apersonal computer system (e.g. a non-mobile or non-portable computingsystem, or the like), a mobile computing device, a personal digitalassistant, a mobile phone, a tablet computing device, a network device,and/or the like. As illustrated in FIG. 5, in accordance with someembodiments of the present invention, the user input system 540 includesa communication interface 542, a processor 544, a memory 546 having anuser application 547 stored therein, and a user interface 549. In suchembodiments, the communication interface 542 is operatively andselectively connected to the processor 544, which is operatively andselectively connected to the user interface 549 and the memory 546. Insome embodiments, the user 545 may use the user application 547 toexecute processes described with respect to the process flows describedherein. Specifically, the user application 547 executes the process flowdescribed in FIGS. 1 and 2.

Each communication interface described herein, including thecommunication interface 542, generally includes hardware, and, in someinstances, software, that enables the user input system 540, totransport, send, receive, and/or otherwise communicate information toand/or from the communication interface of one or more other systems onthe network 510. For example, the communication interface 542 of theuser input system 540 may include a wireless transceiver, modem, server,electrical connection, and/or other electronic device that operativelyconnects the user input system 540 to another system such as the system530. The wireless transceiver may include a radio circuit to enablewireless transmission and reception of information. Additionally, theuser input system 540 may include a positioning system. The positioningsystem (e.g. a global positioning system (GPS), a network address (IPaddress) positioning system, a positioning system based on the nearestcell tower location, or the like) may enable at least one of the userinput system 540 or an external server or computing device incommunication with the user input system 540 to determine the location(e.g. location coordinates) of the user input system 540.

Each processor described herein, including the processor 544, generallyincludes circuitry for implementing the audio, visual, and/or logicfunctions of the user input system 540. For example, the processor mayinclude a digital signal processor device, a microprocessor device, andvarious analog-to-digital converters, digital-to-analog converters, andother support circuits. Control and signal processing functions of thesystem in which the processor resides may be allocated between thesedevices according to their respective capabilities. The processor mayalso include functionality to operate one or more software programsbased at least partially on computer-executable program code portionsthereof, which may be stored, for example, in a memory device, such asin the user application 547 of the memory 546 of the user input system540.

Each memory device described herein, including the memory 546 forstoring the user application 547 and other information, may include anycomputer-readable medium. For example, memory may include volatilememory, such as volatile random access memory (RAM) having a cache areafor the temporary storage of information. Memory may also includenon-volatile memory, which may be embedded and/or may be removable. Thenon-volatile memory may additionally or alternatively include an EEPROM,flash memory, and/or the like. The memory may store any one or more ofpieces of information and data used by the system in which it resides toimplement the functions of that system.

As shown in FIG. 5, the memory 546 includes the user application 547. Insome embodiments, the user application 547 includes an interface forcommunicating with, navigating, controlling, configuring, and/or usingthe user input system 540. In some embodiments, the user application 547includes computer-executable program code portions for instructing theprocessor 544 to perform one or more of the functions of the userapplication 547 described and/or contemplated herein. In someembodiments, the user application 547 may include and/or use one or morenetwork and/or system communication protocols.

Also shown in FIG. 5 is the user interface 549. In some embodiments, theuser interface 549 includes one or more output devices, such as adisplay and/or speaker, for presenting information to the user 545. Insome embodiments, the user interface 549 includes one or more inputdevices, such as one or more buttons, keys, dials, levers, directionalpads, joysticks, accelerometers, controllers, microphones, touchpads,touchscreens, haptic interfaces, microphones, scanners, motiondetectors, cameras, and/or the like for receiving information from theuser 545. In some embodiments, the user interface 549 includes the inputand display devices of a mobile device, which are operable to receiveand display information.

FIG. 5 also illustrates a system 530, in accordance with an embodimentof the present invention. The system 530 may refer to the “apparatus”described herein. The system 530 may include any computerized apparatusthat can be configured to perform any one or more of the functions ofthe system 530 described and/or contemplated herein. In accordance withsome embodiments, for example, the system 530 may include a computernetwork, an engine, a platform, a server, a database system, a front endsystem, a back end system, a personal computer system, and/or the like.Therefore, the system 530 may be a server managed by the entity. Thesystem 530 may be located at the facility associated with the entity orremotely from the facility associated with the entity. In someembodiments, such as the one illustrated in FIG. 5, the system 530includes a communication interface 532, a processor 534, and a memory536, which includes a system application 537 and a datastore 538 storedtherein. As shown, the communication interface 532 is operatively andselectively connected to the processor 534, which is operatively andselectively connected to the memory 536.

It will be understood that the system application 537 may be configuredto implement any one or more portions of the various user interfacesand/or process flow described herein. The system application 537 mayinteract with the user application 547. It will also be understood that,in some embodiments, the memory includes other applications. It willalso be understood that, in some embodiments, the system application 537is configured to communicate with the datastore 538, the user inputsystem 540, or the like.

It will be further understood that, in some embodiments, the systemapplication 537 includes computer-executable program code portions forinstructing the processor 534 to perform any one or more of thefunctions of the system application 537 described and/or contemplatedherein. In some embodiments, the system application 537 may includeand/or use one or more network and/or system communication protocols.

In addition to the system application 537, the memory 536 also includesthe datastore 538. As used herein, the datastore 538 may be one or moredistinct and/or remote datastores. In some embodiments, the datastore538 is not located within the system and is instead located remotelyfrom the system. In some embodiments, the datastore 538 storesinformation or data described herein.

It will be understood that the datastore 538 may include any one or morestorage devices, including, but not limited to, datastores, databases,and/or any of the other storage devices typically associated with acomputer system. It will also be understood that the datastore 538 maystore information in any known way, such as, for example, by using oneor more computer codes and/or languages, alphanumeric character strings,data sets, figures, tables, charts, links, documents, and/or the like.Further, in some embodiments, the datastore 538 may include informationassociated with one or more applications, such as, for example, thesystem application 537. It will also be understood that, in someembodiments, the datastore 538 provides a substantially real-timerepresentation of the information stored therein, so that, for example,when the processor 534 accesses the datastore 538, the informationstored therein is current or substantially current.

It will be understood that the embodiment of the system environmentillustrated in FIG. 5 is exemplary and that other embodiments may vary.As another example, in some embodiments, the system 530 includes more,less, or different components. As another example, in some embodiments,some or all of the portions of the system environment 500 may becombined into a single portion. Likewise, in some embodiments, some orall of the portions of the system 530 may be separated into two or moredistinct portions.

In addition, the various portions of the system environment 500 may bemaintained for and/or by the same or separate parties. It will also beunderstood that the system 530 may include and/or implement anyembodiment of the present invention described and/or contemplatedherein. For example, in some embodiments, the system 530 is configuredto implement any one or more of the embodiments of the process flowsdescribed and/or contemplated herein in connection any process flowdescribed herein. Additionally, the system 530 or the user input system540 is configured to initiate presentation of any of the user interfacesdescribed herein.

In accordance with embodiments of the invention, the term “module” withrespect to a system may refer to a hardware component of the system, asoftware component of the system, or a component of the system thatincludes both hardware and software. As used herein, a module mayinclude one or more modules, where each module may reside in separatepieces of hardware or software.

Although many embodiments of the present invention have just beendescribed above, the present invention may be embodied in many differentforms and should not be construed as limited to the embodiments setforth herein; rather, these embodiments are provided so that thisdisclosure will satisfy applicable legal requirements. Also, it will beunderstood that, where possible, any of the advantages, features,functions, devices, and/or operational aspects of any of the embodimentsof the present invention described and/or contemplated herein may beincluded in any of the other embodiments of the present inventiondescribed and/or contemplated herein, and/or vice versa. In addition,where possible, any terms expressed in the singular form herein aremeant to also include the plural form and/or vice versa, unlessexplicitly stated otherwise. Accordingly, the terms “a” and/or “an”shall mean “one or more,” even though the phrase “one or more” is alsoused herein. Like numbers refer to like elements throughout.

As will be appreciated by one of ordinary skill in the art in view ofthis disclosure, the present invention may include and/or be embodied asan apparatus (including, for example, a system, machine, device,computer program product, and/or the like), as a method (including, forexample, a business method, computer-implemented process, and/or thelike), or as any combination of the foregoing. Accordingly, embodimentsof the present invention may take the form of an entirely businessmethod embodiment, an entirely software embodiment (including firmware,resident software, micro-code, stored procedures in a database, or thelike), an entirely hardware embodiment, or an embodiment combiningbusiness method, software, and hardware aspects that may generally bereferred to herein as a “system.” Furthermore, embodiments of thepresent invention may take the form of a computer program product thatincludes a computer-readable storage medium having one or morecomputer-executable program code portions stored therein. As usedherein, a processor, which may include one or more processors, may be“configured to” perform a certain function in a variety of ways,including, for example, by having one or more general-purpose circuitsperform the function by executing one or more computer-executableprogram code portions embodied in a computer-readable medium, and/or byhaving one or more application-specific circuits perform the function.

It will be understood that any suitable computer-readable medium may beutilized. The computer-readable medium may include, but is not limitedto, a non-transitory computer-readable medium, such as a tangibleelectronic, magnetic, optical, electromagnetic, infrared, and/orsemiconductor system, device, and/or other apparatus. For example, insome embodiments, the non-transitory computer-readable medium includes atangible medium such as a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), a compact discread-only memory (CD-ROM), and/or some other tangible optical and/ormagnetic storage device. In other embodiments of the present invention,however, the computer-readable medium may be transitory, such as, forexample, a propagation signal including computer-executable program codeportions embodied therein.

One or more computer-executable program code portions for carrying outoperations of the present invention may include object-oriented,scripted, and/or unscripted programming languages, such as, for example,Java, Perl, Smalltalk, C++, SAS, SQL, Python, Objective C, JavaScript,and/or the like. In some embodiments, the one or morecomputer-executable program code portions for carrying out operations ofembodiments of the present invention are written in conventionalprocedural programming languages, such as the “C” programming languagesand/or similar programming languages. The computer program code mayalternatively or additionally be written in one or more multi-paradigmprogramming languages, such as, for example, F#.

Some embodiments of the present invention are described herein withreference to flowchart illustrations and/or block diagrams of apparatusand/or methods. It will be understood that each block included in theflowchart illustrations and/or block diagrams, and/or combinations ofblocks included in the flowchart illustrations and/or block diagrams,may be implemented by one or more computer-executable program codeportions. These one or more computer-executable program code portionsmay be provided to a processor of a general purpose computer, specialpurpose computer, and/or some other programmable data processingapparatus in order to produce a particular machine, such that the one ormore computer-executable program code portions, which execute via theprocessor of the computer and/or other programmable data processingapparatus, create mechanisms for implementing the steps and/or functionsrepresented by the flowchart(s) and/or block diagram block(s).

The one or more computer-executable program code portions may be storedin a transitory and/or non-transitory computer-readable medium (e.g. amemory) that can direct, instruct, and/or cause a computer and/or otherprogrammable data processing apparatus to function in a particularmanner, such that the computer-executable program code portions storedin the computer-readable medium produce an article of manufactureincluding instruction mechanisms which implement the steps and/orfunctions specified in the flowchart(s) and/or block diagram block(s).

The one or more computer-executable program code portions may also beloaded onto a computer and/or other programmable data processingapparatus to cause a series of operational steps to be performed on thecomputer and/or other programmable apparatus. In some embodiments, thisproduces a computer-implemented process such that the one or morecomputer-executable program code portions which execute on the computerand/or other programmable apparatus provide operational steps toimplement the steps specified in the flowchart(s) and/or the functionsspecified in the block diagram block(s). Alternatively,computer-implemented steps may be combined with, and/or replaced with,operator- and/or human-implemented steps in order to carry out anembodiment of the present invention.

While certain exemplary embodiments have been described and shown in theaccompanying drawings, it is to be understood that such embodiments aremerely illustrative of and not restrictive on the broad invention, andthat this invention not be limited to the specific constructions andarrangements shown and described, since various other changes,combinations, omissions, modifications and substitutions, in addition tothose set forth in the above paragraphs, are possible. Those skilled inthe art will appreciate that various adaptations, modifications, andcombinations of the just described embodiments can be configured withoutdeparting from the scope and spirit of the invention. Therefore, it isto be understood that, within the scope of the appended claims, theinvention may be practiced other than as specifically described herein.

What is claimed is:
 1. A computer program product for a quality analysisframework for assessing and controlling the quality of a project, thecomputer program product comprising a non-transitory computer-readablemedium comprising code causing at least one processing device to:receive electronic data associated with the project using a network ofdistributed servers, wherein the project comprises one or more phases,each of the one or more project phases comprises one or moredeliverables and each of the one or more deliverables comprises one ormore sub-deliverables; initiate presentation of a user interface fordisplay on electronic computing devices of one or more users, the userinterface comprising information associated with the project; whereinthe project information comprises a phase level, a deliverable level anda deliverable level artifact, wherein the phase level comprisesinformation associated with one or more project phases, the deliverablelevel comprises information associated with one or more deliverables andthe deliverable level artifact comprises information associated with oneor more deliverables and information associated with one or moresub-deliverables; initiate access to the project information from theelectronic computing devices of the one or more users, whereininitiating access further comprises: receiving a first set ofauthentication credentials from a first user via the electroniccomputing device; verifying the first set of authentication credentials;enabling the first user to view the information presented on the userinterface based on at least the verification of the first set ofauthentication credentials; receiving a second set of authenticationcredentials from the first user via the electronic computing device;verifying the second set of authentication credentials; and enabling thefirst user to modify the information presented on the user interfacebased on at least the verification of the first set of authenticationcredentials and the second set of authentication credentials; processthe one or more deliverables, wherein processing the one or moredeliverables comprises: evaluating the one or more sub-deliverablesassociated with each of the one or more deliverables, wherein evaluatingthe one or more sub-deliverables further comprises implementing adeliverable quality assurance program to evaluate the quality of the oneor more deliverables, wherein implementing the deliverable qualityassurance program, for each deliverable of the one or more deliverables,further comprises: receiving a first score, wherein the first scorecomprises a first value associated with a first level of quality,wherein the first level of quality is associated with a sub-deliverableassociated with the deliverable; receiving a second score, wherein thesecond score comprises a second value associated with a second level ofquality, wherein the second level of quality is associated with thesub-deliverable associated with the deliverable; processing the firstscore and the second score to generate a third score, wherein the thirdscore is a review score for the sub-deliverable associated with thedeliverable; and receiving a weight corresponding to the sub-deliverableassociated with the deliverable; assigning a total quality score to eachof the one or more deliverables using the deliverable quality assuranceprogram based on the review scores and the weights associated with theeach of the one or more sub-deliverables; and determining an overallscore for each of the one or more project phases by combining the totalquality scores of each of the one or more deliverables; compare thetotal quality score value of each of the one or more deliverables to afirst threshold value and each of the overall scores to a secondthreshold value; determine if one or more deliverables require action inresponse to comparing each of the total quality score values to thefirst threshold value; determine if the one or more project phasesrequire action in response to comparing each of the overall scores tothe second threshold value; and transmit control signals configured tocause the electronic computing devices of the one or more users toreceive a message based on at least determining whether the one or moredeliverables and/or the one or more project phases requires action. 2.The computer program product of claim 1, wherein the project comprisesat least one of a project goal, a product, or a report.
 3. The computerprogram product of claim 1, wherein the one or more deliverablescomprise at least one of a responsible party or a team.
 4. The computerprogram product of claim 1, wherein the deliverable quality assuranceprogram further comprises a checklist to evaluate the quality of each ofthe one or more deliverables, wherein the checklist comprises a scoringcriteria and a comment for each of the one or more sub-deliverables,wherein at least a portion of the checklist is automatically prefilled,and wherein at least a portion of the checklist is completed by the oneor more users through a communication interface associated with the userapplication of the mobile devices of the one or more users.
 5. Thecomputer program product of claim 1, wherein the total quality scorecomprises a numerical value.
 6. The computer program product of claim 1,wherein processing the one or more deliverables comprises utilizing acontrol management system.
 7. The computer program product of claim 6,wherein the control management system comprises at least one of aproprietary or a third-party control system.
 8. The computer programproduct of claim 1, wherein the second threshold value is associatedwith one of the one or more project phases.
 9. The computer programproduct of claim 4, wherein one or more of the sub-deliverables areassociated with a control objective.
 10. The computer program product ofclaim 1, wherein the action comprises: review of the one or moredeliverables and review of the one or more project phases.
 11. Thecomputer program product of claim 1, wherein the message comprises atleast one of the total quality score, the overall score, the status ofthe deliverable quality assurance program and whether the one or moredeliverables require action, and/or the one or more project phasesrequire action.
 12. The computer program product of claim 1, whereincomparing the total quality score of each of the one or moredeliverables to the first threshold value and comparing the overallscore of each of the one or more project phases to the second thresholdvalue comprises calculating a difference between each of the scores andthe corresponding threshold value.
 13. The computer program product ofclaim 1, wherein a color is associated with at least one of the firstscore, the second score, the associated sub-deliverable or theassociated deliverable.
 14. The computer program product of claim 13,wherein the color indicates at least one of a status, a level ofcompletion, or a level of quality.
 15. The computer program product ofclaim 1 comprises a numerical value that defines a threshold that, whencrossed, determines at least one of a color, a status, or a qualityscore of the sub-deliverable.
 16. The computer program product of claim1, wherein the first score and the second score comprise at least one ofquantitative information and qualitative information.
 17. A computerimplemented method for a quality analysis framework for assessing andcontrolling the quality of a project comprising: receiving electronicdata associated with the project using a network of distributed servers,wherein the project comprises one or more phases, each of the one ormore project phases comprises one or more deliverables and each of theone or more deliverables comprises one or more sub-deliverables;initiating presentation of a user interface for display on electroniccomputing devices of one or more users, the user interface comprisinginformation associated with the project; wherein the project informationcomprises a phase level, a deliverable level and a deliverable levelartifact, wherein the phase level comprises information associated withone or more project phases, the deliverable level comprises informationassociated with one or more deliverables and the deliverable levelartifact comprises information associated with one or more deliverablesand information associated with one or more sub-deliverables; initiatingaccess to the project information from the electronic computing devicesof the one or more users, wherein initiating access further comprises:receiving a first set of authentication credentials from a first uservia the electronic computing device; verifying the first set ofauthentication credentials; enabling the first user to view theinformation presented on the user interface based on at least theverification of the first set of authentication credentials; receiving asecond set of authentication credentials from the first user via theelectronic computing device; verifying the second set of authenticationcredentials; and enabling the first user to modify the informationpresented on the user interface based on at least the verification ofthe first set of authentication credentials and the second set ofauthentication credentials; processing the one or more deliverables,wherein processing the one or more deliverables comprises: evaluatingthe one or more sub-deliverables associated with each of the one or moredeliverables, wherein evaluating the one or more sub-deliverablesfurther comprises implementing a deliverable quality assurance programto evaluate the quality of the one or more deliverables, whereinimplementing the deliverable quality assurance program, for eachdeliverable of the one or more deliverables, further comprises:receiving a first score, wherein the first score comprises a first valueassociated with a first level of quality, wherein the first level ofquality is associated with a sub-deliverable associated with thedeliverable; receiving a second score, wherein the second scorecomprises a second value associated with a second level of quality,wherein the second level of quality is associated with thesub-deliverable associated with the deliverable; processing the firstscore and the second score to generate a third score, wherein the thirdscore is a review score for the sub-deliverable associated with thedeliverable; and receiving a weight corresponding to the sub-deliverableassociated with the deliverable; assigning a total quality score to eachof the one or more deliverables using the deliverable quality assuranceprogram based on the review scores and the weights associated with theeach of the one or more sub-deliverables; and determining an overallscore for each of the one or more project phases by combining the totalquality scores of each of the one or more deliverables; comparing thetotal quality score value of each of the one or more deliverables to afirst threshold value and each of the overall scores to a secondthreshold value; determining if one or more deliverables require actionin response to comparing each of the total quality score values to thefirst threshold value; determining if the one or more project phasesrequire action in response to comparing each of the overall scores tothe second threshold value; and transmitting control signals configuredto cause the electronic computing devices of the one or more users toreceive a message based on at least determining whether the one or moredeliverables and/or the one or more project phases requires action. 18.The computer implemented method of claim 17, wherein the projectcomprises at least one of a project goal, a product, or a report. 19.The computer implemented method of claim 17, wherein the one or moredeliverables comprise at least one of a responsible party or a team. 20.The computer implemented method of claim 17, wherein the deliverablequality assurance program further comprises a checklist to evaluate thequality of each of the one or more deliverables, wherein the checklistcomprises a scoring criteria and a comment for each of the one or moresub-deliverables, wherein at least a portion of the checklist isautomatically prefilled, and wherein at least a portion of the checklistis completed by the one or more users through a communication interfaceassociated with the user application of the mobile devices of the one ormore users.
 21. The computer implemented method of claim 17, wherein thetotal quality score comprises a numerical value.
 22. The computerimplemented method of claim 17, wherein processing the one or moredeliverables comprises utilizing a control management system.
 23. Thecomputer implemented method of claim 22, wherein the control managementsystem comprises at least one of a proprietary or a third-party controlsystem.
 24. The computer implemented method of claim 17, wherein thesecond threshold value is associated with one of the one or more projectphases.
 25. The computer implemented method of claim 20, wherein one ormore of the sub-deliverables are associated with a control objective.26. The computer implemented method of claim 17, wherein the actioncomprises: review of the one or more deliverables and review of the oneor more project phases.
 27. The computer implemented method of claim 17,wherein the message comprises at least one of the total quality score,the overall score, the status of the deliverable quality assuranceprogram and whether the one or more deliverables require action, and/orthe one or more project phases require action.
 28. The computerimplemented method of claim 17, wherein comparing the total qualityscore of each of the one or more deliverables to the first thresholdvalue and comparing the overall score of each of the one or more projectphases to the second threshold value comprises calculating a differencebetween each of the scores and the corresponding threshold value. 29.The computer implemented method of claim 17, wherein a color isassociated with at least one of the first score, the second score, theassociated sub-deliverable or the associated deliverable.
 30. Thecomputer implemented method of claim 29, wherein the color indicates atleast one of a status, a level of completion, or a level of quality. 31.The computer implemented method of claim 17 comprises a numerical valuethat defines a threshold that, when crossed, determines at least one ofa color, a status, or a quality score of the sub-deliverable.
 32. Thecomputer implemented method of claim 17, wherein the first score and thesecond score comprise at least one of quantitative information andqualitative information.